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ABSTRACT  rule,  which  we  believe  has  some  desirable  theoretical  properties. 

Section  3  offers  some  conclusions  about  the  rule.  An  expanded 
A  new  initial  bias  deletion  rule  is  described.  Theoretical  version  of  the  work  described  here  will  be  available  in  a  forth- 

motivation  for  the  rule  is  given,  and  some  directions  on  further  coming  paper  (Glynn  and  Iglehart  (1988)). 

research  are  provided. 


A  new  initial  bias  deletion  rule  is  described.  Theoretical 


1.  INTRODUCTION 

Consider  a  real-valued  stochastic  process  Y  =  {I'll)  :  t  >  0) 
which  is  ergodic,  in  the  sense  that  there  exists  a  finite  (deter¬ 
ministic)  constant  m  such  that 


P(0  =  7 


f  K(»l* 

Jo 


as  t  —  oo.  The  steady-state  simulation  problem  is  concerned 
with  the  estimation  of  ji,  and  production  of  associated  confi¬ 
dence  intervals. 

The  limit  relation  (1.1)  immediately  suggests  using  the  es¬ 
timator  V((),  namely  the  sample  mean  of  Y  up  to  time  (.  A 
difficulty  with  this  approach  is  that 


in  general.  The  bias  in  P(i)  is  a  consequence  of  using  an  atypical 
initial  condition  to  start  the  simulation;  atypical  refers  here  to 
an  initial  condition  which  is  not  typical  of  the  steady-state  of  the 
process.  For  example,  queueing  simulations  of  open  queueing 
networks  are  typically  initiated  with  all  stations  idle.  In  this 
setting,  one  generally  sees  the  customer  population  build  up  to 
a  “steady-state". 

The  bias  difficulty  (1.2)  is  often  called  the  initial  bias  prob¬ 
lem.  This  initial  bias  problem  has  historically  attracted  consid¬ 
erable  attention  within  the  simulation  community. 


2.  A  NEW  INITIAL  BIAS  DELETION  RULE 

Suppose  that  Y  =  {K(t)  : «  >  o)  can  be  represented  as  Y(t)  = 
/(X(«)),  where  X  »  (X(t)  :  (  >  0}  is  a  continuous-time  Markov 
chain  on  state  space  5  =  (0,1,2,...).  If  X  is  positive  recurrent 
and  irreducible,  then 


p  =  £»•/(*) 

it  5 

where  the  »,’s  are  the  stationary  probabilities  of  X.  Suppose  V 
is  a  r.v.  independent  of  X  such  that 


T  =  inf(l>0.X(t)=V}. 

We  claim  that  (XIT  +  <) :  t  >  0}  is  a  stationary  continuous-time 
Markov  chain,  so  that  the  post-T  process  is  in  “steady-state". 
To  see  this,  observe  that  for  suitably  measurable  functions  fc( ), 


Ek(X(r  +  0  «  >  0)  =  £  £{*(*(?  -*-«):*>  0)|V  =  »>  *, 

■»s 

-  E(*(X(T,  +  <)  :  (  >  0)} 


where  T,  =  inf(t  >  o  :  X(i)  =  i).  By  the  strong  Markov  property 


One  way  to  deal  with  this  initial  bias  difficulty  is  to  delete 
those  initial  observations  most  severely  “contaminated"  by  the 
initial  condition;  such  methods  are  called  initial  bias  deletion 
flea.  l,i  oeciicr.  2,  we  briefly  describe  a  new  initial  bias  deletion  so 


£-{*(X(r.  +  t)  :  I  >  0)}  =  £{*(X(<)  :  (  >  0)|X(0)  =  .) 
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A  New  Initial  Bias  Deletion  Rule 


Ek{X{T  +  t)-.t>0)  =  Yi  *tE{k{X(t) :  f  >  0)|X(0)  =  .} 

»«s 

But  the  right-hand  side  is  the  expected  value  of  the  functional 
k( )  integrated  against  the  probability  distribution  of  a  station¬ 
ary  continuous-time  Markov  chain. 

Thus,  if  one  could  generate  such  a  T,  the  initial  bias  deletion 
problem  would  be  completely  solved  by  deleting  all  observations 
collected  prior  to  time  T.  Of  course,  since  T  involves  using 
the  stationary  probabilities  explicitly,  construction  of  such  a 
random  time  T  in  a  practical  context  is  infeasible. 

As  a  consequence,  it  makes  sense  not  to  use  this  rule  ex¬ 
plicitly,  but  instead  to  attempt  to  ‘‘mimic’’  it.  Rather  than 
using  the  s.'s  to  generate  T,  we  use  the  empirical  steady-state 
distribution’s  *,’s.  Specifically,  let 


»,(e)  =  ±£/(X(«)  ««)<*. 


Let  y(()  be  the  r.v.  with  the  conditional  distribution 


P{V(t)  -  i|X}  -  ♦.(«) 


and  let 


T(t]  —  inf{a  >  0  :  X(s)  =  V (c) } . 

The  idea  is  then  to  delete,  from  the  data  set  (y(j)  :  0  <  j  <  r}, 
all  observations  collected  prior  to  T(t).  This  leaves  the  simu¬ 
lator  with  the  (approximately)  “steady-state"  time  series 
(K(.) :  T(t)  <.<()• 


3.  CONCLUDING  REMARKS 

We  expect  that  the  deletion  rule  T(t)  described  in  Section  2 
mimics  the  rule  given  by  T,  in  the  sense  that 

P{(X(T(t)  +  u)  :  u  >  0).  )  *► 

£>/>{(*(«):  u>0)«) 

i*S 

as  t  —  oo.  However,  this  does  not  necessarily  imply  that  the 
point  estimate 


Lyv* 


obtained  after  deletion  of  the  initial  segment  |o,r(t)]  has  low 
bias.  The  problem  is  that  y(t)  is  a  ratio  of  two  random  variables. 
Such  ratio  estimators  are  notoriously  subject  to  bias  difficulties. 

This  suggests  that  further  theoretical  and  empirical  study 
is  necessary,  in  order  to  determine  the  efficacy  of  the  deletion 
estimator  Y(t).  This  work  will  be  reported  in  Glynn  and  Iglehart 
(1988). 
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